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SYSTEM AND METHOD FOR USING ANONYMOUS TOKENS FOR 
EFFICIENT MEMORY MANAGEMENT 

FIELD OF THE INVENTION 

This invention relates to the field of computer programming and more 
particularly to managing objects and pointers, references or handles to objects. 

BACKGROUND 

It is often necessary to have pointers, references and/or handles 
which locate and identify an object stored in memory. When the object is no longer 
needed, it would be preferable to be able to make the memory used to store the 
object available for reuse. In order for the memory to be available for reuse, it is 
typically necessary to insure that existing pointers, references and/or handles to the 
object are de-allocated, invalidated or otherwise modified so that they can no longer 
be used to access the memory location formerly occupied by the object. Current 
mechanisms available to address this memory management problem are complex, 
resource consuming and error-prone. One such mechanism employs a handle as 
described below. 

A handle is a temporary name or number assigned to an object or 
file. For example, an operating system may assign a (typically sequential) number 
to each file that the operating system opens, as a way of identifying the file. A 
typical way to implement a handle to aid in managing objects is illustrated in FIGs. 
1 and 2. FIG. 1 depicts an exemplary computing environment 10 including a 
computing device 5 comprising a central processing unit 22 and memory 24. 
Memory 24 may be any kind of volatile memory. As shown in FIG. 2, a handle 
102 is associated with an index into a pointer array 104. Pointer array 104 
comprises a series of entries 106, 108, 110...n, to which handle 102 may point. In 
FIG. 2, handle 102 points to the fourth entry 112 in pointer array 104. The fourth 
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entry 112 typically contains a pointer to an object, such as object 114. After object 
114 is de- allocated, the pointer in pointer array 104 entry 112 will point to the 
location in memory formerly occupied by object 114 or to the location in memory 
occupied by a new object or to a location in memory not occupied by any object 
5 (often location zero), causing obvious problems. To prevent these problems, it is 
desirable to somehow locate and modify all pointers, including any copies that may 
exist, that point to the de-allocated object 114. This process frequently requires a 
significant expenditure of system resources. 

There are other well-known techniques to address the memory 
10 management problem. For example, one approach is to structure the programs to 
prevent copying pointers, references or handles when the objects pointed to may not 
exist as long as the pointers, references or handles do. Minimal overhead is 
associated with this option but it is often not possible or not convenient to structure 
programs this way. 

15 Another known technique is to keep a linked list of the pointers, 

references or handles and update the linked list whenever an object pointed to by an 
element of the linked list is de-allocated. A linked list contains at least a pointer to 
the next item in the list and frequently contains a pointer to the previous item in the 
list as well. Use of a linked list requires the use of a data structure containing an 

20 element for the storage of the pointer to the next item in the list ("next pointer") and 
an element for the storage of the pointer to the previous item in the list ("previous 
pointer"), thus a linked list has increased space requirements. Furthermore, all 
code associated with the linked list must update the linked list properly, including 
updating the "next" and (when employed) the "previous" pointers, whenever 

25 additions or deletions to the list occur, creating added programming overhead. If 
multiple programs update the linked list, the linked list must be locked so that two 
processes do not update the list at the same time. When the object pointed to is de- 
allocated, all the pointers, references or handles must be searched for, found and 
updated. Alternatively, the object could remain in memory indefinitely (until re- 

30 boot) and/or be marked invalid so that subsequent access of the object is prevented. 
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This technique would not permit the memory used to store the object to be reused 
and thus would require that the amount of memory available between re-boots would 
be adequate to store all the objects instantiated between re-boots. 

Another known technique would involve keeping track of objects that 
5 are no longer in use, but not immediately making the memory location of the object 
available for re-use. The memory location would remain unavailable until some 
period of time elapsed or until some trigger condition occurred (such as available 
memory is ranning low) at which time a single search could be used to find and 
invalidate all the pointers, references, or handles to all those objects. 

10 Accordingly, a primary goal of the present invention is to provide a 

mechanism for referencing objects that imposes minimal or no restrictions on where 
the references may be stored. A further goal of the present invention is to provide a 
mechanism that imposes little or no extra overhead when copying the object 
references, and that enables the object associated with the reference to be de- 

15 allocated and its memory immediately made available for reuse, without a need to 
search for the copies of the references or to modify the copies, and that involves 
little extra overhead upon object deallocation. 

SUMMARY OF THE INVENTION 

20 The present invention provides a mechanism which eliminates the 

need to search for pointers to de-allocated objects. In one embodiment of the 
present invention an anonymous token includes an anonymous token reuse count and 
an anonymous token value (handle) assigned to an object to identify and locate the 
object in memory. It is presently contemplated that the anonymous token will not 

25 be reused between system boots, and that the anonymous token value will be used as 
an index into an array of token data entries. In a presently preferred embodiment of 
the invention, a token data array entry includes a token data array entry reuse count, 
a token data array entry lock, a token data array entry validity indicator and a token 
data array entry reference to an object (object reference). Illustrative uses of an 
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anonymous token in accordance with the present invention are described below, as 
are other aspects of the present invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

5 The foregoing summary, as well as the following detailed description 

of preferred embodiments, is better understood when read in conjunction with the 
appended drawings. For the purpose of illustrating the invention, there is shown in 
the drawings exemplary constructions of the invention; however, the invention is not 
limited to the specific methods and instrumentalities disclosed. In the drawings: 
10 FIG. 1 is a block diagram showing an exemplary computing 

environment in which aspects of the invention may be implemented; 

FIG. 2 illustrates the way a typical handle may be used to locate 
objects in memory as is known in the art; 

FIG. 3 illustrates the way a handle in accordance with one 
15 embodiment of the invention may be used to locate and manage pointers, references 
or handles to objects in memory; 

FIG. 4 depicts pseudocode describing the assignment of an 
anonymous token value to an object in accordance with one embodiment of the 
invention; 

20 FIG. 5 depicts pseudocode describing an operation associated with an 

object associated with an anonymous token value in accordance with one 
embodiment of the invention; 

FIG. 6 depicts pseudocode describing the de-allocation of an object 
associated with an anonymous token value in accordance with one embodiment of 
25 the invention; and 

FIG. 7 depicts pseudocode describing the management of an available 
list of anonymous token values in accordance with one embodiment of the invention. 



TN242/USYS-0113 5 PATENT 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Overview 

As discussed above, the present invention provides an anonymous 
token for use in managing transient objects. The use of the anonymous token 
eliminates the need to search for pointers, references or handles to an object 
remaining in memory after the object directly or indirectly pointed to is de- 
allocated. In a presently preferred implementation, an anonymous token includes an 
anonymous token "reuse count" and an anonymous token "value", which acts as a 
handle. The value is assigned to an object to identify and locate the object in 
memory. A data structure such as, but not limited to, an array, may be used to 
store data elements associated with the object identified by the token. Data elements 
associated with the object in a presently preferred implementation include a "lock," 
a "reuse count," an "object reference," and a "validity indicator." 

When an anonymous token is needed for an object, a token value is 
obtained from a list of available anonymous token values, and the anonymous token 
value assigned to the object is removed from the list of available token values. In 
addition, the object is assigned the anonymous token value. For example, the 
anonymous token value may be stored in a data element (object anonymous token 
value) associated with the object by appending the object anonymous token value to 
the object. Alternately the object may be linked to the object anonymous token 
value via a database or by other suitable methods. In addition, the data elements of 
the token data array entry associated with the anonymous token value are updated: 
the token data array entry validity indicator is set to indicate validity, the token data 
array entry reuse count is incremented by one, and the token data array entry object 
reference is set to the location of the object in memory. In addition, the anonymous 
token reuse count is set to the token data array entry reuse count. 

By way of further explanation of how an anonymous token may be 
employed, consider what happens when an operation is performed on an object 
identified by an anonymous token. In an exemplary implementation of the present 
invention, the anonymous token reuse count is compared to the token data array 
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entry reuse count of the data array entry associated with the anonymous token value 
of the object. The operation will not be performed if the reuse counts are not 
identical or if the token data array entry validity indicator of the data array entry 
associated with the object does not indicate validity. Moreover, when an object 
associated with an anonymous token is de-allocated, the token data array entry 
validity indicator is set to indicate invalidity, the token data array entry object 
reference is set to zero or to some value indicating that no object is associated with 
the token data array entry, thus orphaning the anonymous token. Any subsequent 
attempt to access an object via an orphaned anonymous token will be rejected 
because the anonymous token reuse count will not match the token data array entry 
reuse count and/or the token data array entry validity indicator will indicate 
invalidity. The anonymous token value is returned to the available list, unless the 
token data array entry reuse count has exceeded some specified maximum value. 

Preferably, whenever a token data array entry is used or modified, 
the entry is locked to prevent another process from modifying the entry 
concurrently. The entry is unlocked after the entry is used or modified. 

Thus, when an object is de-allocated, it is not necessary to search for, 
locate and modify all the copies of the handles. As soon as an object is de- 
allocated, the anonymous token reuse count and the token data array entry reuse 
count associated with the object will no longer agree and/or the token data array 
entry validity indicator will indicate invalidity and the de-allocated object will not be 
accessible by the anonymous token. When a reuse count has reached some 
configurable maximum the anonymous token value is retired by removing the 
anonymous token value from the available token list. 

We will now explain in greater detail the presently preferred structure 
and use of anonymous tokens in accordance with the present invention. 



Anonymous Tokens 

A mechanism is disclosed that overcomes the drawbacks of the prior 
art. In one embodiment of the invention, an anonymous token is created that 
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includes a value used as a handle to an object. The anonymous token also includes a 
reuse count that is used to determine if the location in memory pointed to, is still 
occupied by the object associated with the handle. The anonymous token value is 
also associated with an entry in a token data array. The token data array may 
include a number of entries, up to some configured maximum number. Each entry 
in the token data array includes a number of data elements, preferably including a 
lock element, a reuse count element, an object reference and a validity indicator. 
The object reference of the token data array entry contains a pointer or reference to 
the object identified by the anonymous token value. A data element associated with 
the object contains the anonymous token value associated with the object. 

In one embodiment the anonymous token is comprised of 48-bits, 
wherein none of the 48-bit values will be reused until the system is rebooted. Up to 
2 20 anonymous token values can be valid at any one point in time. When an object 
associated with an anonymous token is de-allocated, the token data array entry data 
for the token associated with the object will be invalidated, orphaning the 48-bit 
anonymous token. Thereafter, any attempt to access a de-allocated object via an 
orphaned anonymous token will be rejected without ever having to search for the 
tokens. Locking insures that only one process at a time updates the central data for 
the token. 

FIG. 3 illustrates a mechanism for managing pointers, references and 
handles to objects in accordance with the present invention. An anonymous token 
202 comprises two integer fields, anonymous token value 204 and reuse count 206. 
Token value 204 contains a number corresponding to an entry in token data array 
210. In exemplary FIG. 3 token data value 204 equals three, that is anonymous 
token 202 is associated with entry 3 214 of token data array 210. Token data array 
210 contains a number of entries, 211, 212, 213, 214, 215... m, where m is some 
maximum number of entries that can be stored in token data array 210. In one 
embodiment of the invention m is 2 20 , but m could be any suitable number. 

In one embodiment token data array 210 contains an "entry 0" 211 
associated with token data value = zero, an "entry 1" 212 associated with token 
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data value = one and so on up to maximum entry number m. Each entry 211, 
212... m of token data array 210 contains a data array lock (e.g., lock 221 for entry 
3 214), a token data array reuse count (e.g., reuse count 222 for entry 3 214), a 
token data object reference (e.g., object reference 223 for entry 3 214) and a token 
data validity indicator (e.g., validity indicator 224 for entry 3 214). Token data 
object reference 223 may point to object 230. Object 230 may be associated with 
data element object token data value 23 1 . 

Anonymous token 202, token data array 210 and object 230 may be 
stored anywhere in the volatile memory 24 of a computer system 10 (FIG. 1). 
Preferably the anonymous tokens generated by the anonymous token algorithms 
cannot be changed by software other than the anonymous token software. 
Preferably anonymous tokens cannot be forged by software other than the 
anonymous token software. Preferably use of the anonymous tokens application 
programming interfaces (APIs) are limited to trusted software. Alternately, use of 
the anonymous token API could be limited by employing well known hardware 
(e.g., memory tag) or software (e.g., compiler enforcement) data protection 
techniques to protect the anonymous tokens. 

When an anonymous token (e.g., anonymous token 202) is valid, that 
is, the anonymous token (e.g., anonymous token 202) is associated with an object 
(e.g., object 230), the reuse count field of the anonymous token will match the reuse 
count field of the corresponding token data array entry. It is unnecessary to 
overwrite or change an obsolete anonymous token, because the reuse count 
mechanism catches and rejects any attempt to use an obsolete anonymous token. 

Hence a mechanism for managing objects in accordance with one 
embodiment of the present invention may comprise the following steps: 1.) 
assigning a anonymous token value to an allocated object 2.) updating data elements 
associated with the anonymous token value 3.) before allowing the object associated 
with the anonymous token to be accessed via the anonymous token, requiring that 
the anonymous token reuse count and the token data array reuse count match and 4.) 
when an object is de-allocated, modifying the token data array validity indicator of 



TN242/USYS-0113 



9 



PATENT 



the entry associated with the de-allocated object, modifying the token data array 
object reference of the entry associated with the de-allocated object and returning 
the anonymous token value associated with the de-allocated object to the available 
list. Preferably, before the anonymous token value is returned to the available list, 
5 the token data array reuse count is checked to see if it has exceeded a configurable 
maximum value. If the reuse count has exceed the maximum allowable value, the 
anonymous token value is not returned to the available list. 
Assigning an anonymous token to an allocated object 

Generally, an object capable of being identified by an anonymous 
10 token may also have other means of identification. In one embodiment of the 
invention, an anonymous token mechanism adds anonymous token identification to 
an object which is already allocated and which already may have another means of 
identification. In the pseudo code of FIGs. 4-7, the object reference passed to a 
procedure such as exemplary procedure GETTOKEN of FIG. 4 is intended to 
15 represent such a means of identifying the object. 

Preferably, entry 0 211 of token data array 210 is not used to contain 
token data for an object such as object 230. An object 230 capable of being 
identified by an anonymous token 202 preferably is associated with an object token 
data value 231 which may be used to store a value that is used as an index into token 
20 data array 210. When an object such as object 230 is allocated, (before it is 
associated with an anonymous token 202), object token data value 231 is preferably 
set to zero, indicating that object 230 has not yet been assigned an anonymous token 
202. 

FIG. 4 illustrates a pseudo-code routine that adds anonymous token 
25 identification to an allocated object such as exemplary object 230. At step 401, a 
procedure finds and returns a free entry in token data array 210, by calling a 
procedure such as TOKENGETTOKEN. 

A list 260 (FIG. 3) of available anonymous token values 261, 
262... m, where m is some maximum number of tokens, is maintained. A procedure 
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such as TOKENGETTOKEN determines a free entry in the token data array by 
accessing the available token values list 260. 

Every time an anonymous token is used to identify and locate an 
object, the reuse count of the token data array entry associated with the object is 
5 incremented. That token data array entry reuse count is then copied to the reuse 
count of the anonymous token associated with the object. When the token data 
array reuse count reaches some configurable maximum number, the token data array 
entry is retired. For example, if the maximum value for reuse count is 10, and the 
value of entry 3 214 reuse count 222 has reached 10, when the object 230 associated 
10 with entry 3 214 is de-allocated, anonymous token 202 token data value = 3 is not 
returned to a list of available token values 260. 

Furthermore, if the number of entries in the available token values 
list 260 is reduced to zero, an error condition will occur. Therefore the maximum 
anonymous token value m preferably should be at least large enough to allow 
15 simultaneous allocation of as many objects (and thus anonymous token values) as 
will ever be in simultaneous use during the time between boots. Preferably the 
maximum value of the reuse count field is large enough so that only a small number 
of entries 211, 212... m in token data array 210 will be retired during the time period 
bounded by two re-boots, assuming the highest reasonable rate of anonymous token 
20 allocation and the longest reasonable time period bounded by two re-boots. 

Assume that procedure TOKEN GETTOKEN called in step 401 
returns a value of "3". 

At step 402, the value returned (3) is compared to zero. If the value 
returned is zero, token data array 210 is full and the procedure returns a value 
25 representing that a resource limit has been reached. 

If the value of the cell returned is not zero, at step 403, the specified 
entry in token data array 210 is locked (e.g., entry 3 214 in token data array 210 is 
locked). 

At step 404 the value contained in object 230' s anonymous token 
30 value 231 is examined. If the value in object anonymous token value 231 is not 
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zero, then object 230 has already been assigned an anonymous token. At step 404 
the value in object anonymous token value 231 is determined. Assume the value 
associated with object 230 anonymous token value 231 is 2. If this is the case, at 
step 406 entry 3 214 in token data array 210 is unlocked. At step 408 entry 2 213 
5 associated with anonymous token value 2 in token data array 210 is locked. If 
validity indicator (not shown) of token data array entry 2 213 indicates that entry 2 
is valid, and the token data array entry 2 object reference (not shown) is the same as 
the object reference passed to the procedure for object 230, then an anonymous 
token with anonymous token value = 2 is constructed, entry 2 213 is unlocked and 

10 entry 3 214 is returned to the available token values list 260 at step 410. 

If, however, token data array 210 entry 2 213 validity indicator 
indicates that the entry is not valid, or the token data entry 2 object reference is not 
the same as the object reference to object 230 passed to the procedure, object 230 is 
no longer allocated and a "bad object" error is returned at step 409 and processing 

15 continues at step 410. At step 410 the token data array 210 entry 2 is unlocked and 
entry 3 214 is returned to the available token values list 260. 

Assume now that the value of object 230 anonymous token value 23 1 
is zero. If, at step 404, the value of object 230 anonymous token value 231 equals 
zero, object 230 has not been associated with an anonymous token. At step 405 

20 token data array 210 entry 3 214 reuse count 222 is incremented by one and token 
data array 210 entry 3 214 object reference 223 is set to the object reference 
provided to the procedure, and token data array 210 entry 3 214 validity indicator 
224 is set to indicate validity. An anonymous token 202 reuse count 206 is set to 
token data array 210 entry 3 214 reuse count 222 and anonymous token 202 token 

25 data value 204 is set to "3". Object 230 anonymous token value 231 is set to 3. A 
variable that is used to indicate whether or not a token has been successfully 
associated with an object is set to indicate success. At step 406 token data array 210 
entry 3 214 is unlocked. At step 407, the anonymous token constructed in step 405 
is returned. 
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Performing an Operation on an Object Associated with an Anonymous Token 

FIG. 5 illustrates a pseudo-code routine that performs an operation on 
an object such as object 230, object 230 being identified by way of an anonymous 
token 202. In one embodiment, a routine could be written for every combination of 
5 object type and operation to be supported via the anonymous token mechanism. 
Alternately, multiple object types and/or multiple operations could be supported by 
a single routine. 

At step 420, the anonymous token 202 anonymous token value 204 is 
validated to see if anonymous token value 204 falls with a specified range of values. 

10 If it does not, the token is invalid. If anonymous token 202 is valid, at step 421 the 
token data array entry represented by anonymous token value 204 is locked. For 
example, assume that the value of anonymous token value 204 is 3, representing 
entry 3 214. In that case, token data array 210 entry 3 214 containing data elements 
lock 221, reuse count 222, object reference 223 and validity indicator 224 are 

15 locked at step 421. If validity indicator 224 does not indicate a valid entry or the 
reuse count 222 of entry 3 214 is not identical to anonymous token 202 reuse count 
206, then token 202 is not valid and the operation is not performed. If validity 
indicator 224 is true and the reuse count 222 of entry 3 214 is identical to 
anonymous token 202 reuse count 206, token 202 is valid and the operation is 

20 performed at step 423. At step 424 the token data array 210 entry 3 214 is unlocked. 
De-allocating an Object Identified by an Anonymous Token 

FIG. 6 illustrates a pseudo-code routine that removes anonymous 
token identification from an allocated object. For every object type capable of 
having anonymous token identification, a de-allocation procedure preferably checks 

25 for validity of the object token data value and invokes a routine such as this before 
de-allocating the object. If an object, such as object 230 associated with an 
anonymous token such as anonymous token 202 is to be de-allocated, a procedure 
such as the procedure shown in FIG. 6 may be performed. 

At step 430, the value in object 230 token data value 231 is retrieved, 

30 using the reference to object 230 passed to the procedure. Assume that object 230 
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token data value 231 is 3. At step 431 token data array 210 entry 3 214 is locked. 
At step 432, if token data array 210 entry 3 214 validity indicator 224 indicates 
validity and token data array 210 entry 3 214 object reference 223 is identical to the 
object reference passed to the procedure, token data array 210 entry 3 214 validity 
5 indicator 224 is set to indicate invalidity and token data array 210 entry 3 214 object 
reference 223 is set to 0. At step 433 entry 3 214 is unlocked. At step 434 the 
token return procedure is called. At step 435 the status of the return token operation 
is returned. 

Managing a List of Available Token Values 

10 FIG. 7 illustrates two pseudo-code routines 700 and 701 that manage 

the list of entries in an available token values list 260. Routine 700 returns a free 
entry in token data array 210 or allocates new anonymous token values, if a 
maximum token value has not been reached. At step 440, the list of available token 
values list 260 is locked. At step 441, if there are no available token values in 

15 available token values list 260, the number of entries in token data array 210 is 
examined to determine if token data array 210 has reached its maximum size. If 
token data array 210 has not reached its maximum size, token data array 210 is 
expanded, initializing new entries with token data array entry x lock set to free, 
validity indicator set to invalid, reuse count equal to zero and object reference equal 

20 to zero. The new entry or new entries are linked to the token available values list 
260. 

At step 442 if the list of available token values 260 contains entries, 
the next available free value is returned. At step 443 available token values list 260 
is unlocked. 

25 Procedure 701 of FIG. 7 illustrates a method in accordance with the 

invention for returning a value to the available token values list 260. An entry value 
l,2,3...m is retired by not linking the value to the available token values list 260. A 
anonymous token value is retired when the corresponding tokens data array entry 
reuse count reaches some maximum value, which in one embodiment is the limit 

30 imposed by the finite size of the containers in which reuse count is stored. 
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Assume that object 230 (FIG. 3) associated with token data value = 3 
231 has been de-allocated. At step 450 if token data array 210 entry 3 214 reuse 
count 222 is less than the designated maximum value mv, token data value "3" is 
linked to the available token values list 260. If token data array 210 entry 3 214 
5 reuse count 222 in not less than the designated maximum value mv, token data value 
"3" is not linked to the available token values list 260 and entry 3 will not be used 
again to identify and locate an allocated object until reboot time, at which time reuse 
count 222 will be reset to zero. 
Locking 

10 In one embodiment of the present invention, the type of locking used 

is simple mutual exclusion locking, implemented by the operating system. When a 
thread or program locks a lock which is not already locked, the lock is marked as 
owned and the thread or program is permitted to proceed. When a thread or 
program locks a lock which is already locked, the operating system blocks its 

15 execution until the owning thread or program unlocks the lock and the blocked 
thread or program is granted ownership. Such a lock is often called a MUTEX. 
Other locking mechanisms are contemplated by the invention. 

CONCLUSION 

20 The programming necessary to effectuate the processes performed in 

connection with the present invention is relatively straight-forward and should be 
apparent to the relevant programming public. Any particular programming 
language or mefhodogies may be employed to effectuate the present invention 
without departing from the spirit and scope thereof. 

25 In the foregoing description, it can be seen that the present invention 

comprises a new and useful mechanism for managing objects. It should be 
appreciated that changes could be made to the embodiments described above without 
departing from the inventive concepts thereof. It should be understood, therefore, 
that this invention is not limited to the particular embodiments disclosed, but it is 

30 intended to cover modifications within the spirit and scope of the present invention 
as defined by the appended claims. 



